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ABSTRACT 

Mardia et al (1989) considered the problem of estimating the parameters of nonsingular multivariate normal 
distribution with certain constraints. Nagmur (2003) considered the problem of estimating the mean sub-vector 
of non-sigular multivariate normal distribution with certain constraints. In this paper we try to estimate mean 
sub-vector under some different constraints and submatrix of £ with certain constraints for a nonsingular 
multivariate normal distribution. 
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I. INTRODUCTION 

Mardia et al (1989) considered the estimation of parameters of non-singular multivariate normal 
distribution with and without constraints. Nagnur (2003) tried to obtain the Mle of sub mean vector of the 
distribution which can be useful in some practical problems. Mardia et al (1989) considered two type of 

constraints on the mean vector fj, . 

i. g = ky. 0 i.e. jo. is known to be proportional to a known vector ja, 0 • For example, the elements of x could 
represent a sample of repeated measurements, in which case g = k 1 

ii. Another type of constraint is R\x = r , where R and r are pre-specified 

The first type of constraint was considered by Nagnur (2003) for sub mean vector of the distribution. In this 
paper, we consider type of constraint for sub mean vector and give the explicit expression for the estimators. 
Mardia et al (1989) also considered constraint on variance-covariance matrix S, viz E=kE0 where Z0 is known. 
We consider constraint on sub matrix of E and obtain its estimator with constraints. 

2. ML Estimator of \i : 

LetXj,X 2 ,...,X n be n iid observation from N p ^ ? J]j population, where S is positive definite matrix. 
Suppose that X , \l and S are partitioned as follows : 



2 ) 



X z 

11 12 

V 21 22 J 



X • r x r, X„ :sxs with r + s = p. Let X and S — [x. 



22 



i=\ 



be the mean 



vector and SSP matrix based on the sample observations X X ,X 2 , X . The sample mean vector and 

SSP matrix is partitioned as 
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V S 21 ^22J 



where S : r x r , S :sxs ,with r + s = p. 

11 22 r 

Our problem is to estimate fi : r X 1 under the constraint Rjj,j = r , where R and r are pre-specified. 

Maximizing the log likelihood subject to this constraint may be achieved by augmenting the log likelihood with 
a Lagrangian expression, i.e. we maximize 



L + = L-nX' (Ru-r) 
where X is a vector of Lagrangian multipliers and L is given by 



(2.1) 



L = - f-log2 7 r-flog|E|-ifrE- 1 5-fU-/^J £ _1 [x-fi 



(2.2) 



Case-1 (E Known ) 

With E assumed to be known, to find m.l.e.'s of ^ we are required to find X for which the solution to 
^ /C =0 satisfies the constraint R IX _ r. 

Observe that L + can be expressed as 

L + =-^log27.-^log|E|-i f rE- 1 5-^{(x- E J , E ll (x- Ei )} 

+f 2 (^' ) S ' 2 fe + ) S22 fe -"A'^-r) (2.3) 



Now 

dL + 



nT l u [x i -^J + nS 12 (x 2 - ^ 2 )-nR'U = 0 (2.4) 



nE 22 (x 2 -^J + nS 21 ^ -^) = 0 (2.5) 



and 

From (2.5) we get 

(* -LlJ = -(2 22 )"E 21 (i i - L ) (2.6) 
Substituting for - |I J in (2.4), we get 
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Since 



we get nL^x^-^^nR'X.. (2.7) 
Thus (x, -M,J= S u Jf'A,, 

Pre-multiplying by R gives ~ Ilj ~ (j®- 1 ^ )^ if the constraint RjJ.^ = r is to be satisfied. Thus, 

we take, 

A, = (^S n i?')" 1 (i?x -r) ,so 

A 

(l 1 =x,-Z il «'X (2.8) 
From (6), the ML estimator of is 

£ ^x.+fs 22 )" 1 ! 21 ^-^) (2.9) 



Case 2 ( E unknown) : 

When the covariance matrix £ is not known, we have to estimate M- ^ » M- 2 anc ^ ^ using the likelihood 
function (2.3) The ML estimator of L is 

aV a"i 

x ; — /i X; — (U (2.10) 



n 

A 



where 5 = ^ 



and \l is the ML estimator of [I under the restriction R fj, = r. 

To estimate ( |^ , ) the likelihood equations are given by (2.4) and (2.5). Now we have 



E = ^- = | + (x- M )(x-/x)' 



(2.11) 



From (2.1 1), we have 



7 = 2T % + E |*-f/||*-/x 



(2.12) 



where H— | p. ] is the solution of (2.4) and (2.5) after replacing Z by 
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Since |J, and |J, have to satisfy these equations, from (2.12) we get the equations 



^' = ji^'ll S n /n + fa'Y, S 2l /n 



(2.13) 



<9 = ffs /n + fFs In 

11 21 



From above equations it follows that 



(2.14) 



~11 ~12 

E -I 



E 2: 



~21 

e 



Hence, from (2.7), we have 



(2.15) 



fx -m. ) = S n R' y« 

Pre multiplying (2.16) by R we get 
(Rx^-r^RS^') X/n 

provided the constraints Ry^ = r is to be satisfied. 
Thus we have 

X = n(RS n R'y (Rx^ -r) 

S 11 R , {RS il Rf 1 (lU i -r 
The ML estimator of is 



3. ML Estimators of L : 

According to Mardia et al (1989), the likelihood function of p-variate normal distribution with constraints 
E = &E , where E is known, is 



(2.16) 
(2.17) 

(2.18) 
(2.19) 



2n l l(x,\l,k) = -plogk — log |2tt:S o | — ^ 'a 
where a = trY^ l S + |x — /I j'Sg'^x — /i j is independent of k. 

Our problem is to obtain estimate of k for the constraint E j j = £E j jq , where E j j q is known and 



(3.1) 
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'11 • 



r x r is a 



submatrix of E . If 



let E n = 



P 0 | — ^ |^ 110 | |^ 22 | p 21^ 110^ 12^ 22 

where C ; - = tr j (e 21 E f^E 12 E ^ ) 
Further, by considering E q ^ as 



j = o 



^E 110 E 12 ^ 
V E 21 E 22y/ 



(3.2) 



then 



, -E _1 E E" 1 

V 22 21 110.2 



-1 ^ 

— E E E" 1 

^ 110 12 22.10 
22.10 I 



where 



^-110.2 - ^1 10 "^12^22^21 > E„ ln — E 



110 "^12^22^21' ^22.10 — ^22 ~T ^21^1 10^12 ; we S et 

k 



trL a S — tr~L 22 S 22 + tr(?, 110 S u E 110 E 12 E 22 S 21 E 22 E 21 E I10 5 12 E 22 E 21 E U0 5 22 ^ + o(k j 
Since, E^ 02 = ^E^ + tf(r 2 ) 

^22.10 - ^22 ~~ "7^22^21^110 + O (k j , 



and 



(3.3) 
(3.4) 

(3.5) 



We have 



[x-H %' (x-fi 



-1 !L1 



Using results (3.2), (3.3) and (3.6) in (3.1) we get 
/ + = 2n~ [ l (x,\l,k) = Const. - ( p + r) log k - pOC * +0 (&~ 2 ) 



2 £12 

(3.6) 



(3.7) 



where 



Const = -p\og2% -logE 110 -logE 2 2 - 2 log 
a* = b +frE _1 5 +(x -u Ve _1 (x -u ) 

s -l 22 22 \ — 2 1-2 ) 22 \— 2 L-2 / 



2 ^21^110^12^22 1 



and 



C 5 _j ^-1(^21^110^12^22) 



c ( 1 1 V 
■ 5 (^21^110^12^22 j 

Thus, if y is known, then the mle of k is 

k 



a 



p + r 



(3.8) 



(3.9) 
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If y. is unknown and unconstrained, then the mle's of y. is x an d that of k is (X / p + r , together these gives 



k = 



p + r 



(3.10) 



Note that for the constraint E 22 = ^ 220 ■ wnere £ 220 * s know 11 ' tne mle's of £ for known g is (3 /(p + s) 
and that of for unknown y is (3 /(p + s) where 

[3 = dr-i + trZ u l S n + (x - ^ j'E- 1 (x - ^ ) , p * = d r i + frl- 1 5 n with 



^12^ 22 ^ 21^ 1/ 



/r --l (^12^ 22^- 21^ 1 / ) 



4. Illustrative Example : 

1. Estimation of sub mean vector with constraint Rfj,^ = r . 

For 47 female cats the body weights (kgs), heart weights (gms), lungs weights (gms) and Kidney weights (gms) 
were recorded. The sample mean vector and covariance matrix are 

f 2.36^ 



x 



f~ \ 
x 
-1 



X 

\~2J 



9.20 
3.56 
2.76 



J 



\\ 

V 21 



22 



J 



^0.0735 0.1937 0.2156 0.3072 A 

0.1937 1.8040 0.1969 0.1057 

0.2156 0.1969 2.1420 0.1525 

0.3072 0.1057 0.1525 2.0136 



v 



j 



that 



Note that here x and S are unconstrained mle's of y and Z. However, from other information we know 

f 2.5 > 



M 



and 



^2 



V^2 J 



10 .0 
3 .5 
2.5 



'I 

1 

I 



v 



^0.07810 0.15620 0.21745 0.31033^ 

0.15620 1.56200 0.17767 0.07322 

0.21745 0.17767 2.15436 0.17338 

k 0.31033 0.07322 0.17338 2.04885, 

With above given information we estimate sub-mean vector JJ^ =2X1 under the constraint R[l^ = r where 
R : 2 x 2 and r:2xl are pre-specified as follows : 



22^ 
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R 



V 



0.45000 0.12500 
0.12500 0.91875 



and 



r = 



2.37500 



9.50000 



For unknown E, we have 



X = n(i?S n R')" 1 (i?X i -r) 



V 



-2.25821 
-0.056431 



J 



2.49993 ^ 
10.00096, 



and 



U = X 

- 2 "2 



22 



21 



V 



3.84642 
3.10968 



For known Z, we have 

^-2.0804^ 



X 



v -0.1706 y 



* -H,j 



J 



{ 2.4999 1 
10.0006 



>E 2 



v 



3.9219 
3.1205 



2. Estimation of sub-matrix En of E with constraint En = k En 0 . 



For E i 



0.1 0.2 
0.2 2.0 



, we have for known jj, k = 0.49426 and for unknown ja, we have k = 0.4886 
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